Cohen’s quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables
نویسنده
چکیده
Cohen’s weighted kappa is a popular descriptive statistic for measuring the agreement between two raters on an ordinal scale. Popular weights for weighted kappa are the linear weights and the quadratic weights. It has been frequently observed in the literature that the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa. In this paper this phenomenon is proved for tridiagonal agreement tables. A square table is tridiagonal if it has nonzero elements only on the main diagonal and on the two diagonals directly adjacent to the main diagonal.
منابع مشابه
Cohen's linearly weighted kappa is a weighted average
An agreement table with n ∈N≥3 ordered categories can be collapsed into n−1 distinct 2×2 tables by combining adjacent categories. Vanbelle and Albert (Stat. Methodol. 6:157–163, 2009c) showed that the components of Cohen’s weighted kappa with linear weights can be obtained from these n−1 collapsed 2× 2 tables. In this paper we consider several consequences of this result. One is that the weight...
متن کاملFixed-effects modeling of Cohen's weighted kappa for bivariate multinomial data
Cohen’s kappa and weighted kappa statistics are the conventional methods used frequently in measuring agreement for categorical responses. In this paper, through the perspective of a generalized inverse, we propose an alternative general framework of the fixed-effects modeling of Cohen’s weighted kappa, proposed by Yang and Chinchilli 2011 . Properties of the proposed method are provided. Small...
متن کاملNurse-Physician Agreement on Triage Category: A Reliability Analysis of Emergency Severity Index
Background and Objectives: MThe Emergency Severity Index (ESI) triage is commonly used in clinical settings to determine the patients’ emergency severity. However, the reliability of this index is not sufficiently explored. The present study examines the inter-rater reliability of ESI by comparing triage ratings as performed by nurses and physicians. Methods: This prospective cross-sectional st...
متن کاملA SAS Macro for Calculating Bootstrapped Confidence Intervals About a Kappa Coefficient
Cohen’s kappa coefficient has become a standard method for measuring the degree of agreement between two raters. Confidence intervals for kappa and weighted kappa based on its asymptotic variance are available in the SAS system through the FREQ procedure. However, this variance can become unreliable as sample size decreases or as kappa approaches unity. This paper presents a SAS macro for calcu...
متن کاملبررس پایایی رادیولوژیست ها و عملکرد آنها در تشخیص وخامت توده های تخمدان از روی سونوگرافی
Background: Intra-rater agreement in observing and decision making in diagnosis of any disease is of great importance.This investigation is to observe and read ultrasound pictures of ovarian cysts and distinguish its category for any radiologist. Distinguishability is one of the related entities in this matter and radiologists;apos ability in correct diagnosis is of great concern. In this study...
متن کامل